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(54) Title: EMULATION COPROCESSOR 

(57) Abstract 

A computer system (5) employ- 
ing a host processor (48, 152) and 
an emulation coprocessor (50, 150). 
The host processor (48, 152) includes 
hardware configured to execute in- 
structions defined by a host instruc- 
tion set architecture, while the emu- 
lation coprocessor (50, 150) includes 
hardware configured to execute in- 
structions defined by a different in- 
struction set architecture from the 
host instruction set architecture ("the 
foreign instruction set arcriitecture'^. 
The host processor core (48, 152) ex- 
ecutes operating system code as well 
application programs which are 
coded in the host instruction set archi- 
tecture. Upon initiation of a foreign 
application program, the host proces- 
sor core (50. 150) communicates with 
the emulation coprocessor core (48, 
152) to cause the emulation copro- 
cessor core (48, 152) to execute the 
foreign application program. Accord- 
ingly, application programs coded ac- 
cording to the foreign instruction set 
architecture can be executed directly 
in hardware. The computer system 
(5) may be characterized as a het- 
erogeneous multiprocessing system 
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to Bus Bridge 12 

White the emulation coprocessor (50. 150) is executing the forcing application program, the host processor (48 1S2> mav execute m. 
erating system routines unrelated to the foreign application program orVnay execute i Those application^Sn * ^ 
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TITLE: EMULATION COPROCESSOR PCT/US99/014S6 

BACKGROIWn ng t he TNYEKTMk 

1- Technical Field 

This invention is related to the field of processors for commits a 

* " ws **« ra Ior computer systems and, more particularly to 
supporting nmluple instruction set architectures within a computer system. 

2. Background Art 
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/ v — etc * The application program is generally cu"f 

^ by the instructions (such as registers, etc.). iMapp Ae system does not insulate the 

i^ons defined by the instruction set architecture, and hence the operating system 

^Ucauonp-gramf^^^ . 

A . , thercfo . ^ often achieve only limited market acceptance, at best 
processors designed therefor will oncn ™™ using the new instruction set 

is difficult and time consuming to recreate application programs usmg the 

ll(!ve l D ^instr^ , >>v the 

^^^^ 

' 8IC ^^' ^^Zl is referred to as "native" or W. while code using instructions defined by a 
processors in a computer system is reierrea to as 
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executing Ac translated program sequence. ^«-i/uayy/uiiM> 

Unfortunately, because each foreign instruction is examined during execution of the program, software 
emulation provides significantly reduced performance of the application program than that achievable on a 
computer system employing the foreign instruction set architecture. Furthermore, more memory is required to 
execute the application program, in order to store the emulation program and sirpporting data structures. If the 
application program includes real time features (e.g. audio and video), these features may operate poorly because 
of the excessive execution time. Still further, processor implementations of an instruction set architecture often 
include a variety of undocumented features (bom known and unknown) which must be modeled by the software 
emulator. Furthermore, complex hardware features (such as the x86 floating point register stack) are difficult to 
model accurately in the software emulator. 

Binary translation suffers from several drawbacks as welL Binary translation is not transparent to me 
user. Binary translation often requires multiple passes through the application program code to successfully 
translate theprogram. In the interim, software emulation may be used to execute the application (with many of 
the aforementioned drawbacks). Sornetimes, a complete translation is not achieved, and hence software 
IS emulation is soil required. 

Several combinations of the above approaches have been employed by computer system companies and 
operating system companies. For example. Digital Equipment Corporation offers its FXI32 system and Microsoft 
offers its Wx86 extension to Windows NT. However, while these approaches have provided functionality, the 
high performance desired of the foreign applications has generally not been satisfied. 
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DISCLOSURE OF INVENTION 
The problems outlined above are in large part solved by a computer system employing a host processor 
and an emulation coprocessor in accordance with the present invention. The host processor includes hardware 
configured to execute instructions defined by a host instruction set architecture, while the emulation coprocessor 
includes hardware configured to execute instructions defined by a different instruction set architecture from the 
host instruction set architecture ("the foreign instruction set architecture"). The host processor executes operatmg 
system code as well as application programs which are coded in the host instruction set architecture. Upon 
initiation of a foreign application program, the host processor conmnimcates with the emulation coprocessor to 
cause the emulation coprocessor core to execute the foreign application program. 

Advantageously, application programs coded according to the foreign instruction set architecture can be 
executed directly in hardware. Execution performance of the application program may be substantially greater 
than that of a software emulation or binary translation methodology. Moreover, execution performance may be 
substantially similar to execution performance of the application program within a computer system based upon a 
processor employing the foreign instruction set architecture, thereby preserving much of the real-time behavior of 
the foreign application program. Software ennilation/binary translation methodologies and combinations thereof 
may be eliminated in favor of hardware execution of the foreign application program Because the emulation 
coprocessor includes hardware functionality for executing the foreign instruction set architecture, the difficulties 
of accurate architecture modeling may be eliminated. The combination of these various advantages may provide 
a high level performance, allowing the foreign application execution performance to be highly acceptable to a 
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user. Accordingly, market acceptance of the computer system based upon the host instruction set architecture 
may be increased. As market acceptance increases, the number of application programs coded for the host 
instruction set architecture may increase as well. Long-term success and viability of the host mstrucrion set 
architecture may therefore be more likely. 

5 Providing hardware functionality for the foreign instruction set architecture within the computer system 

generates additional advantages. In particular, the computer system may be characterized as a heterogeneous 
multiprocessing system. While the emulation coprocessor is executing the foreign application program, the host 
processor may execute operating system routines unrelated to the foreign application program or may execute a 
host application program. Advantageously, the computer system may achieve a substantially higher throughput 

10 on both host and foreign code that would be achievable via computer system employing only the host processor 
smA software emulation/binary translation for the foreign mstrucrion set architecture. 

Broadly speaking, the present invention contemplates an apparatus for a computer system cornprising a 
first processor and a second processor. The first processor is configured to execute first instructions defined by a 
first instruction set arcmtecture. An operating system employed by the computer system is coded using the first 

15 instructions. Coupled to the first processor, the second processor is configured to execute second mstructions 

defined by a second instruction set architecture different than the first instruction set arcrutecture. An application 
program designed to execute within the operating system is coded using the second instructions. The second 
processor is configured to execute the application program while the first processor is configured to execute the 
operating system. Additionally, the second processor is configured to cornmunicate with the first processor upon 

20 rirtrrtipg * ™» nf an opeiatii ig system routine for the application mumam. 

The present invention further contemplates a heterogeneous m ul tiprocessing system c ornprising a first 
processor, a second process, an operating system, and an application program. The first processor is configured 
to execute first instnictions defined The second processor is coupled to the 

first processor, and is configured to execute secomi msrxuctioiis define 

25 different than the first irjstruction set architecture. The operating system is coded using the first instructions, 

while the application program is coded using the second instructions and designed to execute within the operating 
system. The second processor is configured to execute the application program and the first processor is 
configured to concurrently execute a process unrelated to the application program. 

Moreover, the present invention contempl a tes a method for executing an application program coded 

30 iictng wighnieriona from a first instniction set architecture and designed to execute within an operating systeui 
coded "cmg mstructions from a second instruction set architecture different from the first instruction set 
architecture. Imtiation of the application program is detected by the operating system executing upon a first 
processor configured to execute instructions from the second instruction set architecture. A context for the 
application program is established in a second processor configured to execute instructions from the first 

35 instruction set architecture. The application program is executed upon the second processor 

BRIEF DESCRIPTION OF DRAWINGS 
Other objects and advantages of the invention will become apparent upon reading the following detailed 
description and upon reference to the accompanying drawings in which: 
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Fig. 1 is a block diagram of one embodiment of a computer system. 

Fig. 2 is a block diagram of one embodiment of a processor shown in Fig. 1 including a host processor 
core and an emulation coprocessor core. 

Fig. 3 is a block diagram of a process emulating a foreign application. 

Fig. 4 is a flowchart illustrating one embodiment of the initialization of an application program in the 
computer system shown in Fig. 1. 

Fig. 5 is a flowchart illustrating one embodiment of invocation of an emulation interface shown in Fig. 3. 

Fig. 6 is a table illustrating communication commands according to one embodiment of the processor 
shown in Fig. 1. 

Fig. 7 is a block diagram of a second embodiment of the processor shown in Fig. 1. 
Fig. 8 is a flowchart illustrating operation of one embodiment of an interface logic block shown in Fig. 7. 
Fig. 9 is a block diagram of a third embodiment of the processor shown in Fig. 1 . 
Fig. 10 is a block diagram of a second embodiment of a computer system. 
Fig. 11 is a block diagram of a third embodiment of a computer system. 
Fig. 12 is a block diagram of a fourth embodiment of a computer system- 
Fig. 13 is a block diagram of one embodiment of an emulation coprocessor card shown in Fig. 12. 
Fig. 14 is a diagram illustrating a control structure maintained by one embodiment of an executive 
program shown in Fig. 13. 

Fig. 15 is a set of flowcharts illustrating one embodiment of the executive program shown in Fig. 13. 

While the invention is susceptible to various modifications and alternative forms, specific embodiments 
thereof are shown by way of example in the drawings and will herein be described in detail. It should be 
understood, however, mat the drawings and detailed description thereto are not intended to "™it the invention to 
the particular form disclosed, but on the contrary, the intention is to cover all modifications, equivalents and 
alternatives falling within the spirit and scope of the present invention as defined by the appended claims. 

MODELS) FOR CARRYING OUT THE INVENTION 
Turning now to Fig. 1 , a block diagram of one embodiment of a computer system 5 including a 
processor 10 coupled to a variety of system components through a bus bridge 12 is shown. Other embodiments 
are possible and contemplated. In the depicted system, a main memory 14 is coupled to bus bridge 12 through a 
memory bus 1 6, and a graphics controller 1 8 is coupled to bus bridge 1 2 through an AGP bus 20. Finally, a 
plurality of PCI devices 22A-22B are coupled to bus bridge 12 through a Fd bus 24. A secondary bus bridge 26 
may further be provided to accommodate an electrical interface to one or more EISA or ISA devices 28 through 
an EISA/ISA bus 30. Processor 10 is coupled to bus bridge 12 through a CPU bus 34. 

Generally speaking, processor 10 includes a host processor core and an emulation coprocessor core. The 
host processor core comprises hardware configured to execute instructions defined by a host instruction set 
architecture, while the emulation coprocessor core comprises hardware configured to execute instructions defined 
by a different instruction set architecture from the host instruction set architecture ( H the foreign instruction set 
architecture"). The host processor core executes operating system code as well as application programs which are 
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coded in the host instruction set architecture. Upon initiation of a foreign application program, the host processor 
core comrrninicates with die emulation coprocessor core to cause the emulation coprocessor core to execute the 

foreign application program. 

Advantageously, application programs coded according to the foreign instruction set architecture can be 
5 executed directly in hardware via processor 10. Execution performance of the application program may be 
substantially greater man that of a software emulation or binary translation methodology. Moreover, execution 
performance may be substantially similar to execution performance of the application program within a computer 
system based upon a processor employing the foreign instruction set architecture. Software emulation/binary 
translation methodologies and combinations thereof may be e liminate d in favor of hardware execution of the 
10 foreign application program. Because processor 10 includes hardware functionality for executing the foreign 
instruction set architecture, the difficulties of accurate architecture modeling may be eliminated. Furthermore, 
since the foreign application program executes in a period of time similar to execution in a native oomputer 
system, much of the real-time behavior of the foreign application program may be preserved. The combination of 
these various advantages may provide a high level performance, allowing the foreign application execution 
15 perfoirnancetobehiglilyacceptabteto Accordmgly, rnaiket acceptance of me computer s^ 

upon the host instruction set architecture may be increased. As market acceptance increases, thenumberof 
application programs coded for the host mstructicn set archie Long-term success and 

viability of die host instruction set architecture may therefore be more likely. 

Providing hardware functionality for the foreign instruction set architecture within computer system 5 
20 generates addmonal advantages, m particular, cornputer system 5 may be char 

rrmltiprocessing system. While the emulation coprocessor is executing the foreign application program, the host 
processor may execute opting system routines unrelated to the foreign apphcanon program or may execute a 
host application program. Advantageously, computer system 5 may achieve a substantially higher throughput on 
bom host and foreigner that would be acMevablevU 
25 software emulation/binary translation for the foreign instruction set architecture. 
In one particular eml>odbrient, the hc^ 
architecture developed byDighal Equiorr»emCorp^ 
instnu^nsetarcriitecture. However, airy instruction set archi^^ 
architecture. For exairrole, trie host instruction srt 
30 architecture developed by Intel, the MIPS architecture, the SPARC archnectare, etc. Similarly, the foreign 
instruction set architecture 

architecture, including any of the examples listed above. 

It is noted that several different emlxxiiments of computer system 5 and processor 1 0 are shown herein. 
While the embodiments shown in Figs. 1 and 2 are considered to be presently preferred embodiments, any of the 
35 enfcodiments shown herein may be suitable depending upon a variety of design factors mcluding cost, 

development schedule, complexity, etc. Additional embodiments are contemplated within the spirit and scope of 
the appended claims. 

Processor 1 0 is shown in Fig. 1 coupled to an optional L2 cache 38. L2 cache 38 is referred to as a 
"backside L2". as the cache is coupled to processor 10 via a private interface separate from CPU bus 34. L2 
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cache 38 maybe larger than any internal caches employed within processor 10 and may be used to store data for 

more rapid access than that achievable from main memory 14. 

As used herein, die term "processor" refers to at least die hardware for executing instructions defined by 
a particular instruction set architecture. Accordingly, the processor cores shown in Fig. 2 below qualify as 
processors under the present definition. Processors may include additional hardware as desired. 

Bus bridge 12 provides an interface between processor 10, main memory 14, graphics controller 18, and 
devices attached to PCI bus 24. When an operation is received from one of the devices connected to bus bridge 
12, bus bridge 12 identifies the target of die operation (e.g. a particular device or, in the case of PCI bus 24, that 
the target is on PCI bus 24). Bus bridge 12 routes the operation to the targeted device. Bus bridge 12 generally 
translates an operation from the protocol used by the source device or bus to the protocol used by the target 
device or bus. In one embodiment, CPU bus 34 comprises an EV6 bus developed by Digital Equipment 
Corporation and bus bridge 12 comprises an Alpha 21 171 or 21 172 core logic chipset However, any CPU bus 
and suitable bus bridge may be used. 

In addition to providing an interface to an ISA/EISA bus for PCI bus 24, secondary bus bridge 26 may 
further incorporate additional functionality, as desired. For example, in one embodiment, secondary bus bridge 
26 includes a master PCI arbiter (not shown) for arbitrating ownership of PCI bus 24. An input/output controller 
(not shown), either external from or integrated with secondary bus bridge 26, may also be included within 
computer system 5 to provide operational support for a keyboard and mouse 32 and for various serial and parallel 
ports, as desired. An external cache unit (not shown) may further be coupled to CPU bus 34 between processor 
10 and bus bridge 12 in other embodiments. Alternatively, die external cache may be coupled to bus bridge 12 
and cache control logic for die external cache may be integrated into bus bridge 12. 

Main memory 1 4 is a memory in which application programs are stored and from which processor 1 0 
primarily exe cu tes. A suitable main memory 14 comprises DRAM (Dynamic Random Access Memory), and 
preferably a plurality of banks of SDRAM (Synchronous DRAM). 

Pa devices 22A-22B are illustrative of a variety of peripheral devices such as, for example, network 
interface cards, video accelerators, audio cards, hard or floppy disk drives or drive controllers, SCSI (Small 
Computer Systems Interface) adapters and telephony cards. Similarly, ISA device 28 is illustrative of various 
types of peripheral devices, such as a modem, a sound card, and a variety of data acquisition cards such as GPIB 
or field bus interface cards. 

Graphics controller 18 is provided to control die rendering of text and images on a display 36. Graphics 
controller 1 8 may embody a typical graphics accelerator generally known in the art to render three-dimensional 
data structures which can be effectively shifted into and from main memory 14. Graphics controller 18 may 
therefore be a master of AGP bus 20 in that it can request and receive access to a target interface within bus 
bridge 12 to thereby obtain access to main memory 14. A dedicated graphics bus accommodates rapid retrieval 
of data from main memory 14. For certain operations, graphics controller 18 may further be configured to 
generate PCI protocol transactions on AGP bus 20. The AGP interface of bus bridge 12 may thus include 
functionality to support both AGP protocol transactions as well as PCI protocol target and initiator transactions. 
Display 36 is any electronic display upon which an image or text can be presented. A suitable display 36 includes 
a.cathode ray tube ("CRT"), a liquid crystal display ("LCD"), etc. 
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It is noted that, while the AGP, PCI, and ISA or EISA buses have been used as examples in the above 
description, any bus architectures may be substituted as desired. It is further noted that computer system 5 may 
be a multiprocessing computer system including additional processors (e.g. processor 10a shown as an optional 
component of computer system 5, along with an optional L2 cache 38a). Processor 10a may be similar to 

5 processor 10. More particularly, processor 10a may be an identical copy of processor 10. As shown in Fig. 1, 
processor 10a is coupled to bns bridge 12 via a separate CPU bus 34a similar to CPU bus 34. Alternatively, 
processor 10a may share CPU bus 34 with processor 10. 

Turn ing now to Fig. 2, a block diagram of a first embodiment of processor 10 is shown. Other 
embodiments are possible and contenq>lated. In the embodiment of Fig. 2, processor 1 0 includes a bus interface 

1 0 unit 40, a memory management unit (MMU) 42, an instruction cache (Icache) 44, a data cache (Dcache) 46, a 
host processor core 48, and an emulation coprocessor core 50. Bus interface unit 40 is coupled to CPU bus 34 
and to a backside L2 interface 52 to L2 cache 38. Bus interface unit 40 is also coupled to MMU 42, which is 
further coupled to instruction cache 44 and to data cache 46. Both instruction cache 44 and data cache 46 are 
coupled to host processor core 48, and data cache 46 is coupled to emulation coprocessor core 50. Instruction 

15 cache 44 is optionally coupled to emulation coprocessor core 50, as described in further detail below. In the 

»T»yirtHitTigii» of Fig. 2, die elements of processor 10 are integrated onto a semiconductor substrate. A command 
interface 54 is coupled between host processor core 48 and emulation coprocessor core 50. 

Host processor core 48 is configured to fetch instructions from instruction cache 44 and to execute those 
instructions. The instructions may comprise a portion of a host application program, or may comprise a portion 

20 of the operating system employed by computer system 5. One particular portion of the operating system is used 
to crratr prort*""^ i™ turfing initiating a foreign application program. I£ during execution of the create process 
portion of the operating system, a foreign application program is detected as being initiated, host processor core 
48 cc*nnmnicates via command interface 54 with emulation coprocessor core 50. Host processor core 48 
establishes a context within emulation coprocessor core 50 corresponding to die foreign application program 

25 being initiated. Included in the context is an initial program counter address, from which die first instruction in 
the foreign application program is to be fetched. Once the context is established, host processor core 48 provides 
a command to emulation coprocessor core 50 to begin execution. Emulation coprocessor core 50 begins fetching 
instructions at the p rogr am counter address, and executes the instructions according to the foreign instruction set 
architecture. As used herein, the term "context" refers to The context 

30 generally includes die memory pages allocated to the process, as well as register values. 

Emulation coprocessor core 50 is configured to determine if a transition, within die foreign application 
program process, is occurring to instructions coded in the host instruction set architecture. For example, if the 
foreign application program calls an operating system routine, a transition is detected because the operating 
system is coded according to the host instruction set architecture. Additionally, exceptions and other processor 

35 events which lead to operating system code or other code using the host instruction set architecture are transitions. 
Upon detennining that a transition is occurring, emulation coprocessor core 50 communicates via command 
interface 54 to host processor core 48 that emulation coprocessor core 50 has stopped. Host processor core 48 
requests context information to determine die reason for stopping, and takes a corresponding action (e.g. 
executing the called routine or providing the operating system service). Once host processor core 48 determines 
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that the foreign application program may be resumed, host processor core 48 provides context information (if 
n e eded ) and provides the co mman d for emulation coprocessor core 50 to start 

Command interlace 54 may be implemented in a variety of fashions. For example, command interface 
54 may comprise a set of hardwired signals between host processor core 48 and emulation coprocessor core 50. 
Command signals may be assigned to each command defined for command interface 54, as well as a bus for 
passing context values. Alternatively, command interface 54 may comprise FIFOs for communicating between 
the processor cores (Le. one or more FIFOs for messages from host processor core 48 to emulation coprocessor 
core 50 and one or more FIFOs for messages from emulation coprocessor core 50 to host processor core 48). His 
noted mat command interface 54 may be an example of a "communication channel". Generally, a communication 
channel is a connection between a transmitter and a receiver over which messages can be sent A predefined 
protocol may be used to define the messages transxnraed via uu channel. For example, hardwired signals form a 
c ommmi cations channel and combinations of the signals are used to transmit messages. Furthermore. FIFOs 
may form a communicatioiis channel and the messages are encoded as FIFO entries. The FIFOs may simply be 
m a intaine d as queues in memory as well. 
1 5 Host Processor core 48 and emulation coprocessor core 50 share instruction cache 44 and dam cache 46 

in the present embodiment. Host processor core 48 fetches instructions from instruction cache 44 and fetches 
data to be operated upon in response to the instructions from data cache 46. Emulation coprocessor core 50 also 
fetches data from data cache 46. Several embodiments are contemplated for an instruction source for emulation 
coprocessor core 50. In a first ernrx>diment, emulation coprocessor core 50 fetches instructions from instruction 
cache 44, while in a second embodiment emulation coprocessor core 50 fetches instructions from data cache 46. 
Several factors may affect me decision of whether emulation coprocessor core 50 fetches mstmctions from 
instruction cache 44 or from data cache 46. For example, an embodiment m which emulation coprocessor core 
50 executes the x86 instruction set architecture, features such as selfmodifying code are supported. Therefore, 
instruction cache 44 may snoop upon updates to data cache 46 to detect such situations. However, the host 
25 instruction set architecture may not support such features, and snooping by instruction cache 44 of data cache 46 
may be unnecessary. Furthermore, host processor core 48 may access instructions to be executed by emulation 
coirocessor core 50 as data. For example, to provide exception services for foreign application programs 
executed by emulation coprocessor core 50. host processor core 48 may need to examine the instruction for which 
the exception occurred. Accordingly, instructions for emulation coprocessor core 50 may already be stored in 
data cache 46. In yet another contemplated embodiment, emulation coprocessor core 50 includes an instruction 
cache, and instruction cache misses are fetched from data cache 46. 

Host processor core 48 and emulation coprocessor core 50 share MMU 42 in this eml>oaiment as wcIL 
MMU 42 is configured to provide translations from the virtual addresses generated via execution of instructions 
in host processor core 48 and emulation coprocessor core 50 to physical addresses which bus interface unit 40 
may use to read main memory 14 or L2 cache 38. Instruction cache 44 and data cache 46 may also store 
instructions and data according to physical addresses, in which case MMU 42 may be accessed in parallel with 
instruction cache 44 and data cache 46. 
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W ° "o^Lly. the host instruction set architecture and the foreign instruction set architecture define differing 
address translation mechanisms. MMU 42 may support the address translation mechanism defined by the host 
instruction set architecture and translations for both host processor core 48 and emulation coprocessor core 50 
may be provided from the host address translation mechanism. If difFering page sizes are defined for the host and 
foreign instruction set architectures, the protection portion of the translation mechanism may be augmented with 
additional copies of the protection mforrnation to provide mderamdent protection on the granularity of the smaller 
page size, if desired. Alternatively, MMU 42 may be configured to support the address translation mechani sm 
defined by the host instruction set architecture as well as the address translation me ch a ni s m defined by the foreign 
instruction set architecture. The operating system may allocate pages of memory for virtual addresses according 
to the address translation mechanism defined by the host instruction set architecture. Additional software, or 
hardware within MMU 42, may create corresponding translations using the address translation mechanism 
defined by the foreign instruction set architecture. Alternatively, the operating system may create address 
translations within the address translation mechanism of the foreign instruction set architecture as well if the page 
is requested by a foreign application program. 

As shown in Fig. 2, host processor core 48 includes a fetch/decode unit 60, a phirality of functional units 
62A-62C, an order and dependency control block 64, and a plurality of registers 66. Similarly, emulation 
coprocessor core 50 is shown as including a fetch/decode unit 70, a plurality of functional units 72A-72C, an 
order and dependency control block 74, and a plurality of registers 76. Generally, fetch/decode units 60 and 70 
are configured to fetch instruct 

those instructions to determine which of the corresponding functional units 62A-62C and 72A-72C are 
coiifigined to exectite theirs Fetch/decode uxurs 60 a«l 70 may 

functional units 62A-62C and 72A-72C, as well as to order and dependency control blocks 64 and 74, 
respectively. Order and dependent control blocks 64 an^ 
and appropriate somra for operand values are p^ 

execution order is properly maintained. Order and dependency control blocto of W and 74 may coriiprise, f« 
^cample, a reorder buffer and related cm^ Alternatively, order and dependency control blocks 64 and 74 
may comprise any suitable circuitry for performing ordering and dependency control functions. In yet another 
alternative, ordering and dependency operation rnay be pert^^ Registers 66 

and 76 are the registers defined by the conesponding instruction set architecture. 

Furictiorjal units 62A and 72A are shown connected Thesc 
functional units may include memory operation (Le. load and store) functionality. Other functional miits may 
include memory operation functionality as well in alternative errd>odmicnt S . The combination of functional units 
62A-62C provide the hardware used to execute the instructions defined by the host mstruction set architecture. 
Similarly, the combination of firnctional units 72A-72C provide the hardware used to execute the instructions 
defined by the foreign instruction set Microcode techniques may also be employed if desired to simplify 
functional unit design. It is noted that, while multiple functional units are shown in each of cores 48 and 50 in 
Fig. 2, embodiments having more or fewer functional units are contemplated, including eirAodmients which have 
one functional unit in one or both of cores 48 and 50. Furthermore, either of cores 48 or 50 may have more 
functional units than the other. 
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It is noted that, while one emulation coprocessor core is shown in Fig. 2 (and erne emulation coprocessor 

is shown in Figs. 7, 9, 10, 1 1 , and 13 below), it is contemplated that multiple emulation coprocessors may be 
employed. Furthermore, it is contemplated that multiple foreign instruction set architectures may be supported 
using multiple emulation coprocessors. 

Turning now to Fig. 3, a block diagram of a software model employed by one embodiment of computer 
system 5 is shown. Fig. 3 illustrates a host process 80 including a foreign application program 82. The 
embodiment shown may, for example, represent the operation of die Windows NT operating system with the 
Alpha instruction set architecture as die host instruction set architecture and the x86 instruction set architecture as 
die foreign instruction set architecture. Fig. 3 may further represent other operating systems, host instruction set 
architectures, and foreign instruction set architectures. Other embodiments are possible and contemplated. 

Foreign application 82 comprises one or more modules coded in the foreign instruction set architecture. 
The foreign application may include calls to operating system routines. Instead of directly calling the operating 
system routines, each routine is replaced by a "thunlr*. The thunk is a routine having the same name as the 
routine which it replaces (and therefore die same address within the address space of process 80). In the present 
embodiment, the thunk includes a particular, predefined illegal opcode, which causes the emulation coprocessor 
to take an illegal opcode trap (or "exception"). Upon taking an illegal opcode trap, the «-rmi1ati>n coprocessor 
communicates with the host processor to indicate that the foreign application has stopped. For example, die 
emulation coprocessor may include hardware which generates the stop message upon taking the illegal opcode 
trap. Alternatively, the illegal opcode trap handler (code stored at a predetermined address defined to be fetched 
upon the occurrence of the illegal opcode trap) may be coded to provide the stop message. Two sets of thunks are 
shown in Fig. 3, operating system thunks 86 and process thunks 88. Operating system tfrimlrp 86 are used to 
intercept operating system calls, both direct operating system calls coded into die foreign application program 82 
and indirect operating system calls which occur as response to exceptions during execution of foreign application 
program 82. Additionally, process thunks 88 may be included for communicating with a block of host code 90 
included in die process. However, process thunks 88 and host code 90 are optional The aforementioned process 
can be used to detect the transitions between foreign application code and host code. Other embodiments may 
employ other methods for detecting the transition. 

Host process 80 further in c lude s emulation interface code 92 which may be used to communicate 
between die host processor and die emulation coprocessor. Accordingly, operating system thunks 86 may lead to 
invocation of emulation interface code 92 to pass messages between die host processor and emulation 
coprocessor. Furthermore, the host processor may be configured to request context information from the 
emulation coprocessor using emulation interface code 92. While the operating system routines being called by 
foreign application program 82 and corresponding operating system routines provided by operating system 84 
provide the same function, die calling conventions (Le. die manner in which parameters are passed between die 
application and the operating system routine) are different because the instruction set architectures are different 
For example, the number and type of registers differ, and therefore the ability to pass parameters within the 
registers (as opposed to memory locations) differs. Accordingly, emulation interface code 92 may request the 
context values which are the parameters for the call, and may place the parameters in the corresponding registers 
on the host processor. The operating system call may then be performed by the host processor. Subsequendy, the 
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results of the operating system routine may be placed into the emulation coprocessor by reversing the conversion 

of calling conventions. 

Still farther, operating system library code 94 may be inchided in host process 80. For example, 
dynamic load libraries defined in the Windows NT operating system may be resolved via operating system 
5 libraries 94. 

Turning next to Fig. 4, a flowchart is shown illustrating initialization of an application program 
according to one embodiment of the computer system shown in Fig. 1. Other embodiments are possible and 
contemplated. While several steps may be shown in Fig. 4 in a serial order for ease of understanding, any suitable 
order may be used. Furthermore, steps may be performed in parallel as desired. 

10 Upon receiving a command from a user to initiate an application program, the operating system creates a 

process in which the application program executes. The operating system examines die file format of the 
application program to determine what type of code is included in the application program (step }00). For an 
embodiment employing the Windows NT operating system, for example, die portable execution format includes 
an indication of which instruction set architecture the application program is coded for. The portable execution 

15 format is defined as part of application programming interface defined by Windows NT. 

If the application program is determined to be coded according to the host instruction set architecture 
(decision block 102), the operating system establishes die process to as a normal host process and the application 
program is executed by the host processor (step 104). On the other hand, if the application program is determined 
not to be coded according to the host instruction set architecture, the operating system determines if the 

20 application program is coded according to a foreign instruction set architecture which is executable by an 

emulation coprocessor widiin the computer system (decision block 106). If the foreign instruction set architecture 
is executable by die emulation coprocessor, the operating system invokes the emulation coprocessor interface 
code in order to initiate the foreign application program upon die emulation coprocessor (step 108). If the foreign 
instruction set architecture is not executable by die emulation coprocessor, the operating system displays a 

25 message to die user indicating that die application is unsupported (step 1 10). The application program is not 

started in this case. Alternatively, software emulation or binary translation of the application may be provided at 
step 110 if desired. For example, a scheme similar to Digital Equipment Corporation's FXI32 product or 
Microsoft's Wx86 product may be employed. 

Turning next to Fig. 5, a flowchart is shown illustrating one embodiment of invocation of an emulation 

30 interfece shown in Fig. 3 (e.g. step 108 shown in Fig. 4). Other embodiments are possible and contemplated. The 
process context is established by the host processor (using commands transmitted via the command interfece 
between die host processor and the emulation coprocessor). Initial values for die registers are provided, including 
a value for the program counter register which is die virtual address of die first instruction in the application 
program. After establishing die context, the "go" (ie. start executing) command is given to die emulation 

35 coprocessor (step 120). 

The emulation interface code, executing upon die host processor, monitors command interface 54 to 
receive a message from die emulation coprocessor indicating that a transition to host code has been detected (ie. 
a stop message is received from the emulation coprocessor). If a transition to host code is detected (decision 
block 122), the host processor determines if die transition is due to a process exit condition (decision block 128). 
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As WO] be illustrated below in Fig. 6. the stop command may include an indication of the r^^!^^ 
a process exit is detected, a destroy process message is sent to the operating system and the emulation interface 
code exits (step 130). 

On the other hand, if a process exit is not detected, the host processor collects context information, via 
5 command interface 54, to determine which operating system routine is to be executed and what the calling 
parameters are (step 124). The host code is then executed upon the host processor. Context mformation is 
provided, via command interface 54. to the emulation coprocessor. Results provided via execution of the 
operating system routine may be passed, if applicable, to the emulation coprocessor in this fashion. Thego 
command is then provided to cause the emulation coprocessor to continue (step 126), and the host processor 
1 0 continues to monitor for messages from the emulation coprocessor. 

It is noted that there are at least two types of operating system routines wl^ 
foreign application program. The first type is an operating system library routine call intentionally coded into the 
foreign application program. Library routines provide low level services which may be used by many application 
programs, and are used by the application program instead of coding the service themselves. Typically, the 
library routines and parameters used by the routines are documented for the application developer's use.' 
Additionally, operating system routines which provide exception handling may be called. As implied in the 
name, these routines are -called" when the emulation coprocessor detects an exception. For example, page faults 
occurring when an instruction fetch address or data address fails to translate invoke an exception routine to 
allocate a page. 

Page r^ts rmy occur upon the initial access to a particular page. For example, when the emulation 
coprocessor attempts to fetch the first instruction of an application program, the page memding the first 
instruction may not yet be allocated to the application program. Accordingly, the fetch address doe, translate 
and a page fault occurs. " Similarly, each time data is accessed from a new page, a page fault may occur. Page 
faults may also occur if the page is "paged out" to disk to allow a different page to be allocated. 

It is noted that the flowchart of Fig. 5 may be mterrupted under a preemptive multitasking operating 
system such as Windows NT to allow the host processor to execute other tasks (e.g. a host application program or 
an operating system routine unrelated to the application being executed). Furthermore, if multiple foreign 
applications are executing concurrently, multiple processes may be rrionhoring for messages. 

In one embodiment, the emulation interface code may interface to the Wx86 extension to the Windows 
NT operation system. 

Turning now to Fig. 6. a table 140 is shown flrustratmg the command 
command interface 54. Other err 1 bodiments employing different commands, or combinations of different 
commands and one or more commands shown in table 140, are contemplated. 

A read registers command is supported for reading emulation coprocessor registers by the host 
processor. The emulation coprocessor responds to the read registers command by providing the requested register 
values. It is noted that memory values may be read from the emulation coprocessor's context as welL However 
since the emulation coprocessor and the host processor share the same physical memory, the host processor may 
read the memory values directly. As mentioned above, either the same translations are shared by both the host 
processor and the emulation coprocessor, or translations are created according to both the host processor's 
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instruction set architecture and die emulation coprocessor's instruction set architecture for each page allocated to a 

foreign application program. Accordingly, the host processor may view memory allocated to the foreign 

application's context 

Similarly, a write registers command is supported to allow the host processor to update registers within 
5 die emulation coprocessor. The emulation coprocessor receives data provided in the write registers command and 
updates the specified register with die received value. Similar to the above comments regarding reading memory , 
the host processor may update memory in the emulation coprocessor's context as welL 

The go command indica t es to the emulation coprocessor that the emulation coprocessor should begin 
execution. Prior to sending the go command to the emulation coprocessor, an execution pointer is stored into the 
10 program counter register in the emulation coprocessor. The emulation coprocessor, upon receiving the go 
command, begins fetching and executing instructions at the execution pointer. Alternatively, the execution 
pointer may be communicated within die go command, if desired. 

A stop command is transmitted by die emulation coprocessor upon detennining that an architectural 
switch is to be performed due to the execution of die foreign application program (e.g. host code is to be 
15 executed). The stop command informs the host processor that the emulation coprocessor has stopped, and 

provides the reason for the stoppage as welL A variety of reasons for stoppage may be employed as desired. For 
example, reasons for stoppage may include: (i) executing a thunk (as described above) for an operating system 
call; (ii) detecting the end of execution of the foreign application program; or (iii) e xperi encing an exception 
during execution of the application program. If desired, using read registers commands and reading the foreign 
20 application program's memory, the host processor may collect additional context information. 

It is noted that the term "messages' 1 may be used herein to refer to communications between die host 
processor and the emulation coprocessor. It is intended that die term messages and commands be synonymous in 
this disclosure. 

Turning next to Fig. 7, a second contemplated embodiment of processor 10 is shown. The embodiment 
25 of Fig. 7 may be employed, for example, in die embodiment of computer system 5 shown in Fig. 1 . Figs. 3-6 

may generally apply to die embodiment of Fig. 7 as welL Other embodiments are possible and contemplated. As 
shown in Fig. 7, processor 10 includes an emulation coprocessor 150, a host processor 152, and an interface logic 
unit 154. Emulation coprocessor 150 and host processor 154 are coupled to interface logic unit 154, which is 
further coupled to CPU bus 34. Host processor 152 is further coupled to L2 cache 38 via backside L2 interface 
30 52. 

Emulation coprocessor 1 50 may include emulation coprocessor core 50 similar to that shown in Fig. 2, 
as well as caches similar to instruction cache 44 and data cache 46 and an MMU similar to MMU 42. Host 
processor 152 may include host processor core 48 similar to that shown in Fig. 2, as well as caches similar to 
instruction cache 44 and data cache 46 and an MMU similar to MMU 42. 
35 According to one particular embodiment, processor 10 as shown in Fig. 7 comprises three separate 

semiconductor chips attached to a printed circuit board. The printed circuit board may include an edge connector 
and be encapsulated for inclusion in computer system 5. For example, processor 10 may be designed in 
accordance with any of the slot 1, slot A, or slot 2000 specifications developed by Intel and Advanced Micro 
Devices. One chip embodies emulation coprocessor 150. A second chip embodies host processor 152, and a 
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third chip rmH^ interface logic 154. For example, emulation coprocessor 150 and host processor 152 may be 

custom designed semiconductor chips and interfece logic unit 1 54 may be an application specific integrated 

circuit (ASIC), a field programmable gate array (FPGA), etc. Other organizations are possible and contemplated, 

including realizing interface logic unit 154 as a custom semiconductor chip as welL 

The embodiment shown in Fig. 7 allows for a previously designed emulation coprocessor 150 and host 
processor 152 (possibly manufactured using different semiconductor fabrication processes) to be used to form 
processor 10. Emulation coprocessor 150 and host processor 152 may each provide a bus interfece to interface 
logic unit 154 (reference numerals 156 and 158, respectively). For example, bus interfaces 156 and 158 may be 
logically and electrically identical to CPU bus 34. Alternatively, bus interfaces 156 and 158 may operate 
according to different bus protocols and/or electrical specifications than those specified for CPU bus 34. Still 
further bus interfece 156 may differ from bus interfece 158. and interface logic unit 154 may translate 
transactions upon the buses to die appropri ate protocol similar to the operation of bus bridge 12. 

Interfile logic unit 154 provides the command interface functionality (e.g. command interface 54) in the 
embodiment of Fig. 7. Predefined bus cycles dissimilar from memory and I/O bus cycles may be defined upon 
bus interfaces 156 and 158 to communicate the various commands between emulation coprocessor 150 and host 
processor 152. Alternatively, command interface 52 may comprise a set of FIFOs into which emulation 
coprocessor 150 and host processor 152 write commands and from which emulation coprocessor 150 and host 
processor 152 read commands. 

In addition to providing the command interface functionality, interface logic unit 1 54 routes non- 
command (eg. memory and I/O) requests from emulation coprocessor 1 50 and host processor 1 52 to CPU bus 34 
and optionally to die non-requesting processor. Fig* 8 is a flowchart illustrating one embodiment of the routing of 
both command and non-command requests according to one embodiment of interfece logic unit 154. Other 
embodiments are possible and contemplated. The steps shown in Fig. 8 are sometimes illustrated in a serial order 
for ease of understanding. However, die steps may be performed in any suitable order and may be performed in 
parallel as desired. 

Requests (except for coherency requests upon CPU bus 34, which are routed to both host processor 1 52 
and emulation coprocessor 154) are either initiated by host processor 152 or by emulation coprocessor 150. If a 
request is received upon bus interfece 156, the request is initiated by emulation coprocessor 150. If the request is 
received by host processor 158, then the request is initiated by host processor 152. Interfece logic unit 154 
determines the initiator of the request (decision block 160). If the request is initiated by host processor 152, then 
interfece logic unit 1 54 determines if the request is a command for the emulation interface (e.g. a command to 
emulation coprocessor 150 via command interface 54 - decision block 1 62). If die request is a command to 
emulation coprocessor 150, the request is routed to the emulation coprocessor 150 (step 164). CPU bus 34 may 
be unaffected by the command. If the request is not a command to emulation coprocessor 150, interface logic 
unit 154 routes the command to CPU bus 34 (step 166). 

On die other hand, if a request is received from emulation coprocessor 150, the request is routed to host 
processor 152 (step 168). Emulation interface commands are routed to host processor 152 because the destination 
of the request is host processor 152. Memory and I/O requests are routed to host processor 152 to allow 
emulation coprocessor 150 to share host processor 152 f s L2 cache resources (e.g. L2 cache 38). The memory 
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request may be provided by interface logic unit 1 54 in the form of a coherency request, such that host processor 
152 provides die requested data. Alternatively, interface logic unit 154 may employ a predefined bus cycle 
different from the bus cycles provided according to bus interface 158 to request a read of L2 cache 38. In this 
fagti mn, cost savings may be achieved by employing a shared L2 cache between host processor 152 and 
5 emulation coprocessor 150. 

As mentioned above, the request from emulation coprocessor ISO may be either a command for the 
emulation interface (e.g. a command to host processor 152 via command interface 54 or a predefined bus cycle — 
decision block 170) or a memory or I/O request. If the request is an emulation interface command, the request 
may be routed to host processor 152 (step 168) and additional actions may not be needed. On the other hand, if 

10 the request is not an emulation interface command, interface logic unit 154 determines from the response of host 
processor 1 52 to the bus cycle routed thereto (step 1 68) to determine if the request can be satisfied by host 
processor 152 (decision block 172). If the request can be satisfied by host processor 152, the data provided by 
host processor 152 is routed to emulation coprocessor 150 via interface logic unit 154 (step 174). If the request 
cannot be satisfied by host processor 152, the request is routed to CPU bus 34 by interface logic unit 154 (step 

15 166). 

Turning next to Fig. 9, a block diagram of a third embodiment of processor 10 is shown which may be 
employed in computer system 5 shown in Fig. 1, for example. Figs. 3-6 may generally apply to this embodiment 
as well Other embodiments are possible and contemplated. In the embodiment of Fig. 9, processor 10 includes 
^rmiinrifin coprocessor 150 and host processor 152. Host processor 152 shown in greater detail, including a core 
20 48, Icache 44, Dcache 46, MMU 42, and bus interface unit 40. Emulation coprocessor 150 is coupled to host 

processor 152 via connections internal coprocessor 10, including command interface 54. Host processor 152, and 
more particularly bus interface unit 40, is coupled to CPU bus 34 and to L2 cache 38 via back side L2 interface 
52. 

The embodiment of Fig. 9 allows for the sharing of cache and MMU resources between emulation 
25 coprocessor 150 and host processor 152. In other words, emulation coprocessor 150 may exclude caches and 
MMU circuitry in this embodiment Instead, emulation coprocessor 150 may be provided with access to Icache 
44, Dcache 46, MMU 42, and indirectly bus interface unit 40. Advantageously, the amount of circuitry employed 
to realize emulation coprocessor 150 may be reduced substantially. 

It is noted that emulation coprocessor 150 may be configured to fetch instructions from either data cache 
30 46 or instruction cac he 44, in various embodiments, similar to the above description of Fig. 2. Still further, 

emulation coprocessor 150 may include an instruction cache for fetching instructions and may fetch instruction 
cache misses from data cache 46. 

As an alternative to providing command interface 54 within processor 10, FIFOs may be maintained 
within main memory 14 to pass command messages between host processor 152 and emulation coprocessor 150. 
35 It is noted the embodiment of Fig. 9, processor 10 may be realized as a single semiconductor substrate, a 

multichip module, or two or more semiconductors within a slot 1, slot A., or slot 2000 type package, among 
others. 

Turning next to Fig. 10, a block diagram of the second embodiment of computer system 5 is shown. 
Figs. 3-6 may generally apply to this embodiment as well Other embodiments are possible and contemplated. In 
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embodiment of Fig. 10, host processor 152 and emulation coprocessor 150 are each coupled directly to bus bridge 

12. As an alternative to the independent CPU bus connections 34 and 34a, host processor 152 and emulation 

coprocessor 150 may share a common CPU bus 34. Furthermore, host processor 152 is coupled to L2 cache 38 

and emulation coprocessor 150 is similarly coupled to L2 cache 38a. 

In the embodiment of Fig. 10, host processor 152 and emulation coprocessor 150 may each include 

internal cache and memory management facilities. For example, host processor 152 may be a processor ^ si gnrd 

to be included in a computer system without an emulation coprocessor, and similarly, emulation coprocessor 150 

may be a processor designed to be included in a computer system without a host processor (e.g. as the central 

processing unit of the computer system). In other words, host processor 152 and emulation coprocessor 150 may 

be "off-the-shelf parts. Command interface 54 may be provided via main memory 14, such as using FIFOs to 

pass command messages between the processors. Alternatively, command interface 54 may be provided within 

bus bridge 12. As yet another alternative, a private interface separate from CPU buses 34 and 34a may be used to 

provide command interface 54. 

In embodiment of Fig. 10, host processor 152 and emulation coprocessor 150 include a logically and 

electrically equivalent bus interface (i.e. CPU bus 34). Fig. 1 1 is another embodiment of computer system 5 in 

which emulation coprocessor 150 includes a different bus interface than CPU bus 34. Accordingly, computer 

system 5 is shown in Fig. 1 1 includes a bus bridge 180 for translating transactions generated by emulation 

coprocessor 150 from the protocol and electrical signalling characteristics of emulation coprocessor ISO's bus 

interface to that of CPU bus 34a. Accordingly, the embodiment of Fig. 11 supports an off-the-shelf host 

processor 152 and an off-the-shelf emulation coprocessor 150, even if different bus interfaces are used by die host 

processor and emulation coprocessor. 

As with the embodiment of Fig. 10, command interface 54 may be implemented in ™in memory in die 

embodiment Fig. 11. Alternatively, command interface 54 may be provided within bus bridge 12. As yet another 

alternative, a private interface separate from CPU buses 34 and 34a may be used to provide command interface 

54. 

Turning next to Fig. 12, a fourth embodiment of computer system 5 is shown. Other embodiments are 
possible and contemplated. In the embodiment Fig. 12, the emulation coprocessor is included on an emulation 
coprocessor card 22C. Emulation coprocessor card 22C is coupled to PCI bus 24 as shown in Fig. 12. The 
hardware for emulation coprocessor card 22C may, for example, be the Radius Detente AX or MX cards 
manufactured by Reply Corporation of Sunnyvale, California. 

In addition to the operation described above with respect to Figs. 3-6, the embodiment of Fig. 12 may 
include several other operations as welL The command interface may be maintained within memory upon 
emulation coprocessor card 22C. Additionally, because emulation coprocessor card 22C is an I/O device, a driver 
is provided within the operating system for interfacing to Still further, a 

software executive is provided for emulation coprocessor card 22C to allow for multiple application programs to 
be concurrently in execution. Accordingly, commands to create and destroy processes and threads within die 
processes may be added to the set of commands which may be communicated between die emulation coprocessor 
and the host processor as illustrated in Fig. 6. Additionally, commands are provided to allocate pages for use by 
foreign application programs executing upon emulation coprocessor card 22C. Since the emulation coprocessor 
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card 22C appears to be an I/O device to the operating system of computer system 5, when a page is allocated to 

the emulation coprocessor the page is locked into main memory 14 (Le. the page is not selected for page out to a 

disk drive upon receipt of a page allocation request by the operating system). The executive executing upon the 

emulation coprocessor card determines when a page is no longer in use by the application programs executing on 

the emulation coprocessor, and provides a message to unlock a page upon determining that is no longer in use. 

Furthermore, if the emulation coprocessor within «milariftn coprocessor card 22C includes one or more 
caches, the executive executing upon emulation coprocessor card 22C maintains cache coherency between the 
emulation processor caches and caches within host processor 150 and L2 cache 38 (and within host processor 
150a and L2 cache 38a, if included). Alternatively, the caches within die emulation coprocessor may be disabled 
so that cache coherency is not an issue. 

In one particular embodiment, computer system S employs the Windows NT operating system for the 
Alpha instruction set architecture and host processor 150 employs die Alpha instruction set architecture. 
Furthermore, the Windows NT operating system employed by computer system 5 includes the Wx86 emulation 
extensions. However, the code for emulating die x86 processor is replaced by the emulation interface code 
described above. The driver for emulation coprocessor card 22C provides the page locking and unlocking 
functionality in response to lock and unlock requests from die executive. More particularly, the executive 
requests a locked page for either code or data. The driver, in response to die request, uses the Windows NT 
memory manager application programming interface (API) calls to lock die page (Le. prevent swapping the page 
to disk to allow a different virtual page to be assigned to that physical page). Subsequently, die executive may 
determine that die page is no longer needed for application pi o giam execution and may send an unlock message. 
In response, the driver uses the Windows NT memory manager API to unlock die page. Additionally, die driver 
is responsible for initializing the card within the operating system and mapping die memory upon die card. 

The driver and executive for the embodiment of Fig. 12 are based on the packet-based DMA bus master 
model defined by the Windows NT operating system (more particularly, as documented in the Windows NT 
DDK). An adapter object is created using IoAJlocateAdaptexChanneL MDLs (memory descriptor lists) are 
created to describe the virtual to physical mapping of the pages used by the processes. Logical addresses are 
created with IoMapTransfer, and are provided to the emulation coprocessor upon emulation coprocessor card 
22C. Mapping registers are thus created which provide translation of die logical addresses into physical addresses 
within main memory 14 (Le. the host system memory). The emulation coprocessor may thereby access main 
memory 14 directly to fetch instructions and read/write data. In other words, the code is executed and data is 
accessed in place in main memory 14. These accesses may appear as DMA to the host system. Instructions and 
data are thereby provided to emulation coprocessor card 22C 

It is noted that, while a software executive has been described for controlling the emulation coprocessor 
card 22C, other embodiments are possible in which portions of die control are provided in hardware. Such 
embodiments are contemplated. 

Turning next to Fig. 13 a block diagram of one embodiment of emulation coprocessor card 22C is 
shown- Other embodiments are possible and contemplated. As shown in Fig. 13, emulation coprocessor card 
22C includes a PCI interface 190, the emulation coprocessor 150, and a memory 194. PCI interface 190 is 
coupled to PCI bus 24, memory 194, and emulation coprocessor 150. Emulation coprocessor 150 is further 
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coupled to memory 194. Memory 194 includes storage for the executive program 196 and for the command 

queues 198 used to pass command messages between executive program 196 and the driver for emulation 

coprocessor card 22C as well as emulation interface code 92. In other words, command queues 198 may 

comprise command interface 54. It is noted that, while instructions and data are preferably nc-crasfd from main 

memory 14 directly by emulation coprocessor 150 9 alternative embodiments may store instructions and data 

transferred from pages in main memory 14 in memory 194 as welL 

As mentioned above, emulation coprocessor card 22C may be a Radius Detente AX or MX cards 

manufactured by Reply Corporation. These products may include additional hardware features not shown in Fig. 

13. Hardware features may be used or not used as desired when the card is used as emulation coprocessor card 

22C. 

Turning now to Fig. 14, a diagram illustrating a control structure maintained by one embodiment of 
executive program 196 is shown. Other embodiments are possible contemplated. In the pmh^^^t of Fig. 14, 
the control structure comprises a process list 200 which is a doubly-linked list of the processes active within 
emulation coprocessor card 22C. For example, in Fig. 14, three processes 202A, 202B, and 202C are active. 
Each process may comprise one or more threads. For example, process 202A includes threads 204 A, 204B, and 
204G Similarly, process 202B includes threads 204D, 204E, and 204F. Process 202C includes thread 204G. 
Each process may further be allocated one or more pages of memory within which instructions and data 
corresponding to the process are stored. For example, process 202A is allocated pages 206A, 206B, and to 206C. 
Similarly, process 202B is allocated pages 206D and 206E. Process 202C is allocated pages 206F and 206G. 

As illustrated in Fig. 14, each process 202A-202C may be allocated different number of pages 206 and a 
different number of threads 204 than die other processes 202A-202C When a process 202A-202C experiences a 
page fault, a new page may be allocated to that process via executive program 196 requesting a page via 
command queues 198. The page request includes an indication that the page is to be locked. A process 202A- 
202C may explicit release a page when processing within that page is completed (e.g. dynamically allocated 
memory), upon which executive program 196 may transmit an unlock page message. Furthermore, a page may 
be associated with a particular thread within the process. Such a page may be released upon exit of the thread to 
which the page is associated. Additionally, when a process is destroyed, the executive program 196 may transmit 
unlock page messages for each page assigned to that process. 

Executive program 196 may maintain a global message queue within command queues 198 for create 
and destroy process command messages, and may maintain message queues within en rnma^ g»m~i 198 for each 
thread which contain command messages for that thread- In this manner, the executive program may be 
configured handle multiple process, multiple thread applications. The threads specific command messages may 
include the lock and unlock page messages as well as create and destroy messages for each thread and go and stop 
messages for each thread. Accordingly, process scheduling may be handled by the operating system executing 
upon computer system 5. The go and stop messages may be used to perform scheduling. Furthermore, the read 
and write registers commands shown in table 140 may be provided on a thread by thread basis as well. 

Turning now to Fig. 15, a set of flowcharts illustrating operation of one embodiment of executive 
program 196 is shown. Other embodiments are possible and contemplated. In the embodiment of Fig. 15, a first 
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flowchart 220 illustrates reset of coprocessor card 22C, a second flowchart 222 illustrates an idle process, and a 

third flowchart 224 illustrates other aspects of executive program 196. 

Upon reset of coprocessor card 22C (e.g. upon boot of computer system 5), flowchart 220 is performed 
Executive program 196 initializes its environment upon coprocessor card 22C (step 226). For example, executive 
program 196 may clear memory 194 to a known state, create page tables for use by emulation coprocessor 150 
(and initializing entries for use by executive program 196 itself), and create command queues 198. After 
initinliCTg die idle process (step 228), the reset procedure is completed. As illustrated by flowchart 222, the idle 
process does nothing (step 230) until interrupted (eg. via receipt of a message in command queues 198). 

Flowchart 224 illustrates operation of executive ptogiam 196 while processes are active within 
coprocessor card 22C. Flowchart 224 includes several entry points 232, 234, and 236 depending upon a variety 
of events which may cause executive program 196 to be invoked. 

Entry point 232 occurs if a message is provided by die driver to command queues 198. Receipt of a 
message causes an interrupt of emulation coprocessor 150, at which time executive program 196 is invoked. 
Upon invocation due to an interrupt, executive program 196 processes the message received (step 238). A variety 
of messages may be received. For example, a create process or create thread message may be received. Upon 
receiving a create process message, executive program 196 adds a process 202 to process list 200. Similarly, 
upon receiving a create thread message, executive piogiam 196 adds a thread 204 to the process 202 which 
received the create thread message. A read context message (e.g. a read registers command) is processed by 
executive program 196 by reading the register from the context data structure associated with that process (and/or 
thread) and generating a response message with the requested information. A write context message (eg. a write 
registers command) is processed by executive pr o gra m 196 by writing the value into the selected context data 
structure. Executive piogiam 196 adds a thread to the list of ready tasks in response to a go message, and 
removes a thread from the list of ready tasks in response to a stop message. A page locked message (issued in 
response to a lock page message previously sent by executive pi ogi am 196) is serviced by executive program 196 
by updating me page tables with a translation for the locked page and adding the thread which experienced the 
page fault to the list of ready tasks. 

After processing the message, executive pr o gram 196 selects a task from die list of ready tasks and 
returns to die selected task (step 240). 

Entry point 234 occurs if a page fault is experienced by a task (e.g. a process thread) being executed by 
emulation coprocessor 150. In response to die page fault, executive program 196 sends a lock page message via 
command queues 198 {step 242). The task experiencing the page fault is removed from die list of ready tasks 
until die page locked message is received for the page. As mentioned above, receipt of the page locked message 
causes the task to be added to the list of ready tasks. Subsequently, executive program 196 selects a task from the 
list of ready tasks and returns to die selected task (step 240). 

Entry point 236 occurs if an illegal opcode trap exception is experienced by emulation coprocessor 1 50. 
A predefined illegal opcode is used to signal that a thunk has been entered (sometimes referred to as a "BOP"). 
Executive program 196 determines if the predefined illegal opcode has been detected (decision block 244). If the 
predefined illegal opcode has not been detected, an exception message is sent via command queues 198 to inform 
the operating system that an illegal opcode exception has been received for the task generating the illegal opcode 
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exception (step 246). If the predefined illegal opcode has been detected, a stop message is sent to inform the 
operating system mat the task has stopped due to a transition to host code (step 24 8). In either case, the task 
experiencing the exception is removed from the list of ready tasks and a ready task is selected from the list of 
ready tasks (step 240). 

5 

Industrial Applicability 

The present invention may be applicable in computer systems. In accordance with the above disclosure, 
a computer system has been shown in which an emulation coprocessor employing one instruction set architecture 
is used to execute foreign application programs coded in that instruction set architecture in a computer system 

1 0 employing an operating system for which the foreign application programs are designed but which is coded 
according to a second instruction set architecture. Advantageously, the number of application programs 
executable by the computer system is increased. Additionally, the performance of the application programs may 
be substantially greater than mat achievable using software emulation and/or binary translation. Still further, 
modeling of architectural idiosyncrasies is eliminated since die emulation coprocessor embodies the architecture. 

1 5 The resulting computer system forms a heterogeneous multiprocessing computer system. 

Numerous variations and modifications will become apparent to those skilled in the art once the above 
disclosure is fully appreciated. It is intended that the following claims be interpreted to embrace all such 
variations and modifications. 
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1. An apparatus for a computer system comprising: 

a first processor (48, 152) configured to execute first instructions defined by a first instruction set 

arehitecture, wherein an operating system (84) employed by said computer system (5) is coded 
using said first instructions; and 

a second processor (50, 150) coupled to said first processor (48. 152), wherein said second processor 
(50,150) is configured to execute second instructions defined by a second instruction set 
architecture different than said first instruction set architecture, wherein an application program 
(82) designed to execute within said operating system (84) is coded using said second 
instructions; 

wherein said second processor (50, 150) is configured to execute said application program (82) and said 
first processor (48. 152) is configured to execute said operating system (84), and wherein said second processor 
(50, 150) is configured to corrxmunicate with said first processor (48, 1 52) upon detecting a use of an operating 
system routine (94) for said application program (82). 

2. The apparatus as recited m claim lwrierem said fr^ 

coupled to one or more caches (44. 46), and wheremsaMfSrst processor (48) ard said se^ 
configured to share said one or more caches (44, 46). 

3. The apparatus as recited in claim 2 wherein said first processor (48) and said second processor (50) are 

25 coupled to one or more memory rnanagement units (42), and wherein said first processor (48) and said second 
processor (50) are configured to share said memory management units (42). 

4. The apparatus as recited in claim 3 wherem said fm« processor (48) and said sec^ 
integrated onto a single seinicondnctor substrate (10). 
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5. The apparatus as recited in claim 1 wherein said first processor (152) and said second processor (150) i 
coupled to a bus bridge (12), and wherein said first processor (152) is coupled to said bus bridge (12) via a CPU 
bus (34), and wherein said second processor (150) is coupled to said bus bridge (12) via a peripheral bus (24) 
having different signalling than said CPU bus (34). 

6. Th C apparatus as recited in claim 1 wherein said second processor (50, 150) comprises a hardware decoder 

(70) configured to decode said second instructions. 

7. The apparatus as recited in claim 1 wherein said first processor (48, 152) and said second processor (50, 150) 
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are configured to communicate via a predetermined control protocol, 

8. The apparatus as recited in claim 7 wherein said control protocol comprises messages passed between said first 
processor (48, 152) and said second processor (SO, ISO). 

9. The apparatus as recited in claim 8 wherein said messages are passed through a memory (14) within said 
computer system (S). 

10. The apparatus as recited in claim 8 wherein said messages are passed through a dedicated communication 
channel (54) between said first processor (48, 152) and said second processor (50, 150). 

11. A heterogeneous multiprocessing system comprising: 

a first processor (48, 152) configured to execute first instructions defined by a first instruction set 
architecture; 

a second processor (50, 150) coupled to said first processor (48, 152), wherein said second processor 
(50, 150) is configured to execute second instructions defined by a second instruction set 
archhectnre different man said first instruction set architecture; 

an operating system (84) coded using said first instructions; and 

an application program (82) coded using said second instructions and designed to execute within said 
operating system (84); 

wherein said second processor (50, 150) is configured to execute said application program (82) and said 
first processor (48, 152) is configured to concurrently execute a process (80) unrelated to said application 
program (82). 

12. The heterogeneous multiprocessing computer system as recited in claim 1 1 wherein said second processor 
(50, 150) is configured to detect a use of an operating system routine (94) within said operating system (84) by 
said application program (82) during execution. 

13. The heterogeneous multiprocessing computer system as recited in claim 12, wherein said second processor 
(50, 150) is configured to detect said use by executing a particular illegal opcode. 

14. The heterogeneous multiprocessing computer system as recited in claim 12, wherein said second processor 
(50, 150) is configured to communicate with said first processor (48, 152) upon detection of said use. 
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15. The heterogeneous multiprocessing computer system as recited in claim 14 wherein said first processor (48, 

152) is configured to request context information from said second processor (50, 150), execute said n|ierat i ng 
system routine (94X and return control of said application program (82) to said second processor (50, 150) via 
communication with said second processor (50, 150). 

16. The heterogeneous multiprocessing computer system as recited in claim 1 1 wherein said process (80) 
unrelated to said application program (82) comprises a second application p ro g ram 

17. A method for executing an application program (82) coded using instructions from a first instruction set 
architecture and designed to execute within an operating system (84) coded using instructions from a second 
instruction set arc hit ec tur e different than said first instruction set architecture, comprising: 

detecting that said application program (82) is being initiated, said detecting performed by said operating 
system (84) executing upon a first processor (48, 152) configured to execute instructions from 
said second instruction set architecture; 

establishing a context for said application program (82) in a second processor (50, 1 50) configured to 
execute instructions from said first instruction set architecture; arid 

executing said application p ro gram (82) upon said second processor (50, 150). 

18. The method as recited in claim 17 further comprising detecting a transition in said application program (82) 
to an operating system routine (94) within said operating system (84). 

19. The method as recited in claim 18 further comprising executing said operating system routine (94) upon said 
first processor (48, 150). 

20. The method as recited in claim 19 further comprising returning to said application p rogi a m (82) nrftc n trn g 
upon said second processor (50, 150) subsequent to said executing said operating system routine (94). 
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